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(54) VOICE RECOGNITION REMOTE CONTROLLER 

(57) Abstract: 

PURPOSE: To improve the operability by controlling remotely plural 
electric devices with a relevant control signal based on the result of 
recognition of a voice recognition means. 

CONSTITUTION: A control signal is retrieved and its relevant electric 
device is specified based on the result of recognizing an input voice 
signal with a voice recognition section 10 according to a device word 
cross reference table 11. Then a control section 13 discriminates 
whether or not the control signal obtained through the retrieval is 
capable of being set by referring the relevant storage in a device state 
memory 12 and a control signal-device state cross reference list 14. 
When the transmission of the control signal is enablethe control signal 
is sent through a communication processing section 3 to implement the 
control of a prescribed device. Thusthe electric device is controlled 
remotely by using a voice without the use of an IC card and the 
operation is facilitated. 



CLAIMS 



[Claim(s)] 

[Claim l]It is a speech recognition remote control unit for operating 
two or more electric appliances by remote control by voice inputtingSaid 
voice inputting recognizes said voice inputting including controlled 



object electric appliance information and control action informationThe 
1st voice recognition means that outputs this recognition resultthe 
apparatus / word correspondence memory measure which associates mutually 
a control signal for electric appliance- control which should be 
generated corresponding to two or more fundamental tone voice 
recognition results and each aforementioned fundamental tone voice 
recognition resultand memorizes itAn equipment state memory measure 
which memorizes information which shows an operating state of said 
electric appliancea memory measure corresponding to the control 
signal/equipment state which associates each aforementioned control 
signal and each aforementioned controlled object electric appliance of 
each otherand memorizes them. A memory measure corresponding to said 
control signal/equipment state was beforehand generated according to an 
operating state of each aforementioned electric appliance. A 
transmitting inhibition condition flag which shows no of a control 
signal ready for sending is matched and stored in each this memorized 
aforementioned controlled object electric applianceThe 2nd voice 
recognition means that searches a control signal of correspondence from 
said apparatus/word storage means based on a recognition result from 
said 1st voice recognition meansWhen a controlled object electric 
appliance of correspondence and a transmitting inhibition condition flag 
of relation are searched and a this searched transmitting inhibition 
condition flag shows ability ready for sending based on a searched this 
control signal from a memory measure corresponding to said control 
signal/equipment stateA speech recognition remote control unit provided 
with a transmitting means which sends out a searched this control signal. 
[Claim 2] It is the speech recognition remote control unit according to 
claim land when a transmitting inhibition condition flag relevant to 
said searched control signal shows ability ready for sending to two or 
more controlled object electric applianceswhile showing two or more of 
these controlled object electric appliance names to an operatorit has 
further a means to stop sending out of a control signal. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application]This invention relates to the speech recognition 
remote control unit for operating two or more electric appliances by 
remote control by voice input especially about the remote control unit 



for operating an electric appliance by remote control. 
[0002] 

[Description of the Prior Art] In order to operate the electric appliance 
in the distant placewithout an operator movinggenerally the remote 
control device (a remote control unit is called below) is usedand is 
widely used also for electrical household machinery and equipmentsuch as 
television. 

[0003] Generally a wireless type thing is used for this remote control 
unit. In a wireless type remote control unitinfrared rays are usedand a 
control signal code carries out pulse modulationand is transmitted. 
There are a method (pulse position modulation) of distinguishing binary 
value "1" and "0" by the width and the position of the method and 
lightwave pulse which distinguish binary value "1" and binary value "0" 
by the existence of a lightwave pulseetc. in the method of this pulse 
modulation. As for a pulse-position-modulation methodgenerally fewmany 
malfunctions are used. 

[0004] A "start marker" for send data to make easy reception of each 
signal which teaches a transmission start to a receiving circuit and is 
generally sent to the nextln order to prevent interference with other 
apparatuscodessuch as a "custom code" defined for every apparatus and 
"datacode" which were defined according to transmission functions and by 
which serial coding was carried outare included. There is a method which 
transmits the "continuation leader code" it is indicated to be that a 
series of send data is transmitted and it is under transmission 
henceforth only at the method with which the method of transmission 
always carries out repeating transmission of a series of send data 
during transmissionand the time of a transmission start. 
[0005] Operation of the target electric appliance is controlled by the 
receiver by a custom code and datacode among this transmitted data. 
Usuallyin order to prevent the interference with other apparatusand 
malfunctionthe send data given to this receiving circuit carries out 
pulse modulation of the career modulated waveand transmits it in many 
cases. 

[0006] Generally it is impossible for one remote control unit to be 
needed to one electric appliance in the remote control unit which 
operates such an electric appliance by remote controland to operate 
another electric appliance by remote control with the same remote 
control unit. For examplean air-conditioner (air conditioner) cannot be 
operated by remote control using the remote control unit for televisions. 
According to the contents of control operationmany switches are formed 
in the remote control unit. 



It is transmitted to the electric appliance which an appliance control 
signal is chosen according to the depression state of this switchand 
serves as an operation target. 

In the case of a videotape recorder etc. there are much contents of 
operationsuch as setting out of a television reception office channel 
and a tape running stateThereforemuch switches are needed also for a 
remote control unitand the problem that operation which there is a 
problem that the operativity is badand pushed and mistook the mistaken 
switch is performed arises. 

[0007] Since a remote control unit was needed for each electric 
appliancethe user always needs to grasp correctly which remote control 
unit corresponds to which electric applianceand there was a problem that 
operation took time and effort. 

[0008]While eliminating the switch of above a large nuraberthe remote 
control unit aiming at operating two or more electric appliances with a 
single remote control unit is indicated by JP2-171098A. In this advanced 
technologyit points to the contents of remote control by voice inputand 
a control signal is generated according to this speech recognition 
result. In the speech recognition remote control unit of this advanced 
technologyin order to correspond to two or more electric appliancesthe 
rewritable map which changes a speech recognition result into a function 
code is providedand the contents of this map are rewritten according to 
the electric appliance used as an operation target. In this advanced 
technologythe conversion code is read into the map from the IC card. 
[0009] 

[Problem(s) to be Solved by the Invention] In the speech recognition 
remote control unit of this advanced technologyit is possible to operate 
two or more electric appliances by remote control with one remote 
control unit. Howeverin order to control two or more electric 
appliancesthe IC card for code conversion is needed for every electric 
appliance which should be controlledand the time and effort which 
inserts an IC card in the main part of a remote control unit beforehand 
according to the electric appliance used as an operation target is 
needed before use. Thereforethe time and effort which needs to grasp 
beforehand which IC card corresponds for every electric appliance also 
in this caseand is inserted before using an IC card is needed. 
[0010] It is also possible to replace with the composition which rewrites 
two or more table maps for control code conversion by substitution of 
such an IC cardand to consider the following composition. That isread- 
only memory is provided in the inside of the main part of a remote 
control unitand the code conversion table corresponding to two or more 



electric appliances of each is written in in this read-only memory. By 
specifying an electric appliance with a switch at the time of useonly 
the table for conversion codes of correspondence is used in this read- 
only memory. In this compositional though the time and effort of 
substitution of an IC card can be savedit is necessary to perform the 
change of the switch for translation table selectionand the check of a 
switch position for every electric applianceand the fault that 
operativity is bad arises. 

[OOlljSothe purpose of this invention is to provide the remote control 
unit which removed the fault which the above-mentioned conventional 
remote control unit hasand was excellent in operativity. 
[0012] 

[Means for Solving the ProblemjA speech recognition remote control unit 
concerning an invention of claim IThe apparatus / word correspondence 
memory measure which associates mutually a control signal for electric 
appliance control which should be generated corresponding to two or more 
fundamental tone voice recognition results and each aforementioned 
fundamental tone voice recognition resultand memorizes itA memory 
measure corresponding to the control signal/equipment state which 
associates an equipment state memory measure which memorizes information 
which shows an operating state of an electric applianceand each 
aforementioned control signal and controlled object electric appliance 
of correspondence of each otherand memorizes them is included. A memory 
measure corresponding to this control signal /equipment state matches 
further with each aforementioned controlled object electric appliance a 
transmitting inhibition condition flag which was beforehand formed based 
on an operating state of a controlled object electric appliance and 
which shows no of a control signal ready for sendingand stores it. 
[0013]A speech recognition remote control unit of an invention of claim 
1 is provided with the following. 

The 1st voice recognition means that recognizes voice inputting and 
outputs this recognition result. 

The 2nd voice recognition means that searches said apparatus / word 
correspondence memory measure based on a recognition result from the 1st 
voice recognition meansand searches a control signal of correspondence. 
This searched control signal includes information which shows electric 
appliance specific information and an operating state which should be 
operated of a controlled object. 

[0014]A speech recognition remote control unit of this invention 
searches a transmitting inhibition condition flag of a controlled object 
electric appliance of correspondenceand relation further according to a 



control signal searched by the 2nd voice recognition means from a memory 
measure corresponding to said control signal/equipment stateWhen a 
transmitting inhibition condition flag relevant to a searched this 
controlled object electric appliance shows ability ready for sendingit 
has a transmitting means which sends out this searched control signal. 
[0015]A speech recognition remote control unit of claim 2 is provided 
with a means to show an operator a controlled object electric appliance 
nameand to suspend transmission of a control signalwhen two or more 
control signals identified by voice inputting exist further and two or 
more of these control signals can be transmitted. 
[0016] 

[Function] Specif ication of search of the control signal with which the 
invention of claim 1 should be generated from apparatus / word 
correspondence memory measure based on the recognition result of voice 
inputtingand the electric appliance name of correspondence is performed. 
The transmitting inhibition condition flag which shows no ready for 
sending beforehand to each control signal according to the operating 
state of each electric appliance is formed. This transmitting inhibition 
condition flag is formed corresponding to each control signal. A control 
signal is sent out when the transmitting inhibition condition flag 
relevant to the searched control signal shows ability ready for sending. 
Therebywhen operating two or more electric appliances by remote 
controlthe specification of an electric appliance and sending out of a 
control signal used as an operation target can be performedwithout 
switching the map for conversion of a speech recognition result and an 
appliance control signal according to the electric appliance used as an 
operation target. 

[0017] In the invention of claim 2when transmission of a control signal 
is possible and one electric appliance cannot be specified to two or 
more electric appliancesan operator is shown the electric appliance name 
which can transmitand transmission of a control signal is suspended. 
Therebythe backup organization when the ability not to specify the 
electric appliance for control operation is taken. 
[0018] 

[Example] Drawing 2 is a figure showing the appearance of the speech 
recognition remote control unit which is one example of this invention. 
A speech recognition remote control unit is stored in drawing 2 by the 
case 1 for storage. The microphone 2 for [ of the case 1 for storage ] 
on the other hand inputting speech information into the surfaceThe 
communication processing part 3 for sending out the control signal 
corresponding to voice inputtingand the switch part 5 for inputting the 



information which directs the transmission permission/cancellation of 
the communication processing part 3The indicator 4 for displaying a 
voice inputting recognition result etc. and the loudspeaker 6 for 
showing confirmed information from a remote control unit to an operator 
are formed. Since the communication processing part 3 sends out a 
control signalfor example according to an infrared systemportionssuch as 
a diode for infrared generating for this control signal sending outcan 
view it from the one side surface of the case 1 for storage. 
[0019]The switch part 5 includes the cancellation switch 5a for 
inputting the information which shows transmitting cancellationand the 
0. K. switch 5b for inputting the information which shows a transmission 
permission. An operator judges this transmission permission/cancellation 
according to the information displayed on the indicator 4. A remote 
control unit expresses the indicator 4 as the gestalt which can view the 
information shown to an operator. In drawing 2w hen a voice inputting 
recognition result is "a request to print out files"the state where this 
recognition result "a request to print out files" was displayed is shown 
as an example. From the loudspeaker 6after a remote control unit changes 
confirmed information or attention information into the gestalt of 
speech information by the voice formation part 60 to an operatorit shows. 
[0020] Drawing 1 is a block diagram showing functionally the composition 
of the whole speech recognition remote control unit which is one example 
of this invention. The apparatus-word correspondence table 11 which 
stores the control signal with which a speech recognition remote control 
unit is generated according to a fundamental tone voice recognition 
result (word) and each fundamental tone voice recognition result (word) 
with a front gestalt in drawing I The sound inputted as the rewritable 
memory 12 for equipment states which stores the information which shows 
the state of the electric appliance used as an operation target via the 
microphone 2 is recognizedand the voice recognition part 10 which 
searches the control signal corresponding to this recognition result 
from the apparatus-word correspondence table 11 is included. 
[0021] The voice recognition part 10 contains the 1st voice recognition 
part 101 that recognizes the sound given from the microphone 2and the 
2nd voice recognition part 102 that searches the control signal of 
correspondence from the apparatus-word correspondence table 11 according 
to the recognition result from the 1st voice recognition part 10. The 
2nd voice recognition part 102 is provided with the function to 
initialize again the equipment state information stored in the memory 12 
for equipment states. 

[0022]The fundamental tone voice recognition result (word) memorized 



beforehand is beforehand generated by the apparatus-word correspondence 
table 11 corresponding to operation with this controllable speech 
recognition remote control unit. An operator gives remote control 
control information by uttering either corresponding to this fundamental 
tone voice recognition result (word). The data storage gestalt of this 
apparatus-word correspondence table 11 is explained in detail later. 
[0023]The information which shows the operating state of each electric 
appliance is stored in the memory 12 for equipment states. This 
equipment state indicative data can be rewritten and those contents are 
rewritten according to the control operation by a remote control unit. 
By enabling rewriting of the contents of this memory for equipment 
states according to a remote control situationA remote control unit 
becomes possible [ judging the kind of electric appliance used as a 
controlled object ] as the use advancesand it will switch the map for 
conversion of a speech recognition result and an electric appliance 
control signal equivalent. 

[0024] Further a speech recognition remote control unit Each control 
signal and an operation target electric applianceThe control signal- 
equipment state conversion table 14 which associates the transmitting 
inhibition condition data (flag) of each other beforehand set up 
corresponding to each control signaland is stored with a front 
gestaltAccording to the control signal given from the voice recognition 
part 10 (the 2nd voice recognition part 102) the transmitting inhibition 
condition data (flag) of change of the contents of the memory for 
equipment states and the control signal-equipment state conversion table 
14 is searchedand the appliance control part 3 which is ability ready 
for sending and which sometimes gives a control signal to the 
communication processing part 3 is included. 

[0025] The communication processing part 3 displays the recognition 
result from the 2nd voice recognition part 102 on the indicator 4and 
when an operator inputs transmission permission information via the 
switch part 5it transmits the control signal. 

[0026] In this casethe communication processing part 3 may be considered 
as the composition which sends out the control signal which is given 
from the appliance control part 13and which can be transmittedwithout 
waiting for the input of the confirmed information from the switch part 
5. The gestalt of the communication method from the communication 
processing part 3 may follow an infrared system as mentioned aboveand 
the lightwave signal using a laser beam may be used. It may be what kind 
of thing about a kinda coding modeetc. of this signal transmittedand 
they may be any as long as a check with the electric appliance in which 



a control signal serves as an operation target is possible. Nextthe 
composition and operation of each part are explained in detail. 
[0027] Drawing 3 is a figure showing an example of the concrete 
composition of the 1st voice recognition part 101 shown in drawing 1 . 
The sonagraphy unit 111 changed into the time series of sound 
parameterssuch as a power spectrumafter the 1st voice recognition part 
101 changes into a digital signal the analog signal inputted from the 
microphone 2 in drawing 3 The word standard pattern dictionary 113 which 
memorizes the time series of the sound parameters of word voices as a 
standard patternSimilarity with the standard pattern memorized by the 
time series and the word standard pattern dictionary 113 of the sound 
parameters given from the sonagraphy unit 111 is calculatedand the word 
recognition unit 112 which outputs the nearest word as a recognized word 
(recognition result) is included. This sonagraphy unit 111 generates the 
time series of the short-time spectrum of the inputted sound (digital 
sound input). Usuallyin sonagraphyevery predetermined time (for 
examplelO thru/or 20 ms) is asked for an audio short-time spectrum after 
high emphasis processing. The band-pass-filter group which consists of 
two or more band-pass filtersor the 8 thru/or 12th linear prediction 
model is usually used for a spectrum analysis. In band-pass-filter 
analysisas a spectrum distance measure for calculation of similaritythe 
Euclidean distance between the feature vectors of a filter output is 
usually used. This 1st voice recognition part just recognizes voice 
inputting. What is necessary is just a thing of composition of 
performing word recognition according to the word-voices recognition 
system of an unspecified speakerand it replaces with the method using 
the word standard pattern shown in drawing 3 and it may be the 
composition of recognizing word voices using a phoneme standard 
patternand other word recognition methods may be used. 
[0028] Drawing 4 is a figure showing an example of the contents of 
storing of the apparatus-word correspondence table shown in drawing 1 . 
In drawing 4 the apparatus-word correspondence table 11 contains control 
signal sequence SR which arranges the control signal which should be 
generated corresponding to the Japanese-syllabary sequence KR which 
shows the pronunciation of the word for controlthe data row HDR for a 
display which arranges the recognition result which should be displayed 
on the indicator 4and a recognition result corresponding to each word. 
Control signal sequence SR contains apparatus sequence AR which 
specifies the electric appliance used as each operation target. The 
control signal which should be generated corresponding to a recognition 
result is arranged for every apparatus sequence AR of this. 



[0029] The word arranged at the word sequence KR is set up beforehand. 
It is determined according to the electric appliance used as an 
operation target. 

In this apparatus-word correspondence table llwhen an operator is wanted 
to perform timer reservationan utterance word serves as "** and **. " In 
this casein order for a recognition result to be shown by the Japanese- 
syllabary sequencethe line corresponding to the line "** and **" of the 
correspondence in the Japanese-syllabary sequence KR of Table 11 is 
chosen. As data for a displaya "request to print out files" in the data 
row HDR for a display is chosen. In this casethe control signals which 
can be uttered are VTRthe deck (cassette tape deck for audios)an air- 
conditioner (air conditioner) etc. in control signal sequence SR. The 
control signal shown by the "0" seal in this control signal sequence SR 
also contains the electric appliance specific information of 
correspondencerespectively. Herecorresponding to one voice inputtingthe 
case where two or more control signals which can be generated exist may 
arise. For examplewhen an operator pronounces with "****"this shows that 
it is being required that the channel of either VTRtelevision and the 
deck should be set as "1. " The specification of the target electric 
appliance which can be transmitted about two or more of these control 
signals is determined according to the transmitting inhibition condition 
data (it explains in full detail behind) in the control signal-equipment 
state conversion table 14 shown in drawing 1 . 

[0030] Drawing 5 is a figure showing the apparatus-word correspondence 
table shown in drawing 4 w ith a general gestalt. The words "Wl-Wn" which 
are basic recognition results are arranged at the Japanese-syllabary 
sequence KRand the data Dl-Dn for a display is arranged at the data row 
HDR for a display corresponding to each word. Corresponding to each 
words "Wl-Wn"the control signal which should be generated under the 
electric appliances MI-MI of correspondence is arranged. For examplethe 
control signal von with which the word Wl should be generated to the 
electric appliance Ml is arrangedcontrol signal ton is arranged on the 
intersection of the word W2 and the electric appliance M2and the control 
signal aup is arranged on the intersection of the word "Wn"and the 
electric appliance M4. When the control signal which should be generated 
to a word does not existbinary value "0" is arranged. In drawing 5 the 
control signal which should be generated to the electric appliance Mi 
corresponding to the word "Wn" is expressed with Mi [N] . 
[0031] Drawing 6 is a figure showing an example of the memory content of 
the memory 12 for equipment states shown in drawing 1 . This memory 12 
for equipment states contains the equipment name column AAR which 



arranges the electric appliance name used as an operation targetand SDR 
which stores condition data S[i] which shows the state of the electric 
appliance of correspondence corresponding to each electric appliance. 
Temporarilystate S[i] presupposes that 2 of operation another specific 
state where there is 3 about a power turn state in the case of land 
there is about a certain 1 of operation specific state in a power OFF 
state in the case of 2 is shown in the case of zero. According to the 
code of this condition data S[i]the operating state of the apparatus of 
correspondence is set up and monitored inside a remote control unit. 
[0032] Drawing 7 is a figure showing the composition of the operating 
buffer memory used by the voice recognition part 10 (the 2nd voice 
recognition part 102) shown in drawing 1 . This buffer memory is not 
clearly shown in drawing I but is contained in the 2nd voice recognition 
part 102. In drawing 7 a buffer memory stores control signal Mi [x] in the 
address which the pointer bufp shows, x is an operating variable here. 
The buffer memory is provided with J buffer registers. 
The address of each buffer register is set up by the pointer bufp. 

[0033] Drawing 8 is a flow chart showing operation of the voice 
recognition part 10 shown in drawing 1 . Hereafterwith reference to 
Drawing Soperation of the voice recognition part 10 shown in this 
drawing 1 is explained. This remote control unit is initialized by the 
powering-on switch which inputs a sound via the microphone 2 firstor is 
not illustrated. The voice recognition part 10 sets all equipment-state- 
data S[i]s stored in the memory 12 for equipment states as the state of 
"0" as initial setting. In this stateall the electric appliances of 
correspondence are power OFF states (Step SI). 

[0034] In this initial statean operator inputs the information for 
operating the electric appliance of correspondence with a sound via the 
microphone 2. The voice recognition part 101 recognizes the sound given 
via this microphone 2and performs recognition execution operation to the 
number of vocabularies of N pieces beforehand stored in the apparatus- 
word correspondence table 11. At this timeN words with a number of 
vocabularies (it corresponds to the words "Wl-WN") are registered also 
into the word standard pattern dictionary 113 shown in drawing 3 . The 
word recognized by the 1st voice recognition part 101 is given to the 
2nd voice recognition part 102. At this timethe information which coded 
the recognition result itself may be given from the 1st voice 
recognition part 101 to the 2nd voice recognition part 102It is good 
also as composition which gives only the number of the word in the word 
dictionary 113 (refer to drawing 3 ) and the apparatus-word 



correspondence table 11 to the 2nd voice recognition part 102. In 
drawing 8 the case where the word numbers (l-N in Wl-WN) x in the 
dictionary 113 or an apparatus-word correspondence table are given to 
the 2nd voice recognition part 102 is shown from the 1st voice 
recognition part 101 (Step S2). 

[0035] It sets the equipment item number i in condition data S[i] as 1 
while setting the pointer bufp of a buffer register as zero firstif the 
2nd voice recognition part 102 can be given [ the word numbers x ] from 
this 1st voice recognition part 101 (Step S3). 
[0036]Subsequentlythe 2nd voice recognition part 102 is accessed 
according to the word numbers x to the apparatus-word correspondence 
table Hand it is distinguished whether control signal Mi[x] of 
correspondence is 0 (step S4) . Therebyselection of the control signal 
which should be generated corresponding to the word numbers x is 
performed. 

[0037] When control signal Mi[x] which is not "O" is searchedthis is a 
control signal which should be generated from a remote control 
unitcontrol signal Mi[x] is stored in the buffer register buf [bufp+1] 
shown in drawing 7 and it ranks secondand 1 increment of the buffer 
register pointer bufp is carried out. Therebycontrol signal Ml [x] is 
first stored to the buffer register of a buffer pointer "1 (=bufp+l)" 
(Step S5). 

[0038] In step S4when control signal Mi[x] corresponding to the electric 
appliance i is Oit progresses to Step S6. 

[0039] In Step S61 increment of the electric appliance name number i is 
carried outand it is distinguished whether the value of i by which 1 
increment was subsequently carried out in this step S7 is over the total 
number I of electric appliances. When i was larger than I and it is 
distinguished at Step S7it is shown that the control signal relevant to 
all the electric appliances was investigated corresponding to the word 
which had this recognized (I would like to be cautious of electric 
appliances being MI-MI here). 

[0040]When it is judged that search to all the electric appliances is 
omitted yet in Step S7it returns to step S4and distinction of whether 
control signal Mi [x] located in the intersection of this electric 
appliance and the word numbers x (or word "Wx") is 0 is performed. 
[0041]When i was larger than I in Step S7 and it is distinguishedit is 
shown that all search of the control signal over the recognition result 
Wx of voice inputting was performedand all control signal Mi[x]s stored 
in the buffer memory shown in drawing 7 are outputted to the appliance 
control part 13 (Step S8). The number of control signal Mi[x]s sent out 



to this appliance control part 13 is given by the buffer pointer bufp. 
[0042]Herein the above-mentioned flowall of an electric appliance name 
and a word are expressed with the numberand the search operation is 
performed according to this number. At this timein the apparatus-word 
correspondence tablethe word for the power turns of the electric 
appliance of correspondence in the words "Wl-WI" is storedand the word 
for the power OFF of the electric appliance of relation is stored in the 
field of this Wl+1 - W2 and I. That isgrouping is carried out for every 
operating state of each electric applianceand a word is stored in an 
apparatus-word correspondence table. 

[0043] The appliance control part 13 searches the control signal which 
can be transmitted based on the apparatus transmitting inhibition 
condition data stored in change of the contents of the memory 12 for 
equipment statesand the control signal-equipment state conversion table 
14 when all control signals were received from the voice recognition 
part lOThe control signal in which the searched this transmission is 
possible is sent out to the communication processing part 3. 
[0044] In Step S2the data for a display is also searched from the 
apparatus-word correspondence table 11 according to the word numbers x 
of a recognition result. This searched data for a display is transmitted 
to the communication processing part 3. Processing of this data for a 
display is explained later. 

[0045]Nextthe details of execution operation of the appliance control 
part 13 of step S9 shown in drawing 8 are explained. 

[0046] Drawing 9 is a figure showing an example of the memory content of 
a control signal-equipment state conversion table. In drawing 9 the 
control signal-equipment state conversion table 14Corresponding to the 
word numbers kthe inhibition condition data row ISR which stores 
equipment name column ASR and the transmitting inhibition condition E 
[k] of apparatus which store the electric appliance D [k] used as the 
control signal sequence SSR and operation target which store the control 
signal C [k] which should be generated is included. The transmitting 
inhibition condition data E [k] is beforehand set up corresponding to 
the control signal C [k]. For examplein "von" to which the control 
signal C [k] makes the power supply of a videotape recorder oneif the 
power supply of a videotape recorder is already in an ON stateit is not 
necessary to perform transmission of this control signal von. At this 
timelwhich "1" which shows a videotape recorder as a target electric 
appliance is set up as electric appliance name D [k] corresponding to 
the control signal vonand shows a power turn state as transmitting 
inhibition condition [ of this videotape recorder ] E [k] is set up. 



[0047] In addition to thisprohibition of a change of the channel under 
video recordingetc. is set as this transmitting inhibition condition 
data E [k]for example. The recognized word Wi is "1" which shows the 
channel land this is realized by being set as "2"for examplethe 
operation target electric appliance D [k] is set to a videotape recorder 
and the transmitting inhibition condition data E [k] of correspondence 
shows a recording operation state. That iswhen the operating state is in 
agreement with the transmitting inhibition condition E [k] according to 
an operating state with the electric appliance D [k] which the control 
signal C [k] specif iestransmission of control signal C [k] is forbidden. 
Thereforethe electric appliance specified by the electric appliance D 
[k] stored in electric appliance name sequence ASR in this control 
signal-equipment state conversion table 14 be cautious of it not being 
necessarily in agreement the electric appliance name which actually 
receives the control signal C [k]. For examplepower OFF operation of the 
television under video recording is forbidden. 

[0048]Nextoperation of the appliance control part 13 is explained with 
reference to drawing 10 in which the operation flow is shown. 
[0049]Herealso in the appliance control part 13the case where the buffer 
register shown in drawing 7 is provided as an operating register is 
assumed. Each control signal is stored in the buffer register of 
correspondence by a register pointer like [ the buffer register in this 
appliance control part 13 ] the buffer register in the voice recognition 
part 10. 

[0050] j shows the pointer of this buffer register. The pointer bufp used 
with the buffer register of drawing 7 shows the number of storing 
control signals of this buffer register, buf [j] shows the buffer 
register of the pointer j. It is 1 <=j<=J. The word numbers k of the 
control signal -equipment state conversion table 14 fill 1 <=k<=K. 
[0051]The appliance control part 13 judges first whether the pointer 
bufp of the buffer register is "0" (Step Sll). Since the control signal 
which should be transmitted is not stored in the buffer register at all 
when the buffer register pointer bufp is "0"the appliance control part 
13 ends the operation. 

[0052] In order to choose the 1st buffer register as ** judged as the 
buffer register pointer bufp of drawing 7 not being "0" in Step Sll 
firstthe pointer j is set as 1. Therebythe buffer register buf (l) is 
specified (Step S12). Subsequentlyin order to search the inhibition 
condition in a control signal-equipment state conversion tablek is set 
as 1. Therebycontrol signal [ of the 1st line ] C [1] in a control 
signal-equipment state conversion tableelectric appliance D [l]and the 



transmitting inhibition condition data E [l] are specified (Step S13). 
[0053]Distinction of whether the control signal which the buffer 
register buf [j= l] specified in Step S12 memorizes is equal to the 
control signal C [k= 1] included in a control signal-equipment state 
conversion table is performed (Step S14). 

[0054] When coincidence is found out in Step 14the appliance control part 
13 searches condition data [ of electric appliance / of the memory 12 
for equipment states / D [k= 1] ] S [D[k]]. Distinction of whether 
equipment-state-data S [D[k=l]] searched from this memory 12 for 
equipment states is in agreement with the transmitting inhibition 
condition data E [k= 1] stored in the control signal-equipment state 
conversion table 14 is performed (Step S15). 

[0055] In Step S15when equipment-state-data S [D[k=l]] was not equal to 
the communication inhibition condition data E [k= 1] and it is 
distinguishedthis control signal C [k= 1] is a control signal which 
should be transmittedand the control signal C [k= 1] is transmitted to a 
communication processing part (Step S16). The processing which this 
communication processing part performs is explained later. 
[0056]The appliance control part 13 changes the value of condition data 
S [D[k=l]] stored in the memory 12 for equipment states according to the 
control signal C [k= 1] after outputting the control signal C [k= 1] to a 
communication processing part. That isfor exaraplewhen the control signal 
C [k= 1] is a power turn signalthis condition data S [D[k=l]] is set as 
landin the case of a power source off signalcondition data S [D[k=l]] is 
set up "0. " 

[0057]When the storage control signal of the buffer register buf [j] is 
not in agreement with the control signal C [k= 1] stored in the control 
signal-equipment state conversion table 14 in Step S14In order to search 
the control signal of the correspondence in this control signal- 
equipment state conversion table 141 increment of the value of k is 
carried out (Step S18). 

[0058] Are carried out by distinction of whether the value of this k is 
larger than the word "severalK" stored in the control signal-equipment 
state conversion table 14 ranking second (Step S19)and when the value of 
this k is smaller than the value of Kit returns to Step S14 againand 
search of the control signal of the correspondence in the control 
signal-equipment state conversion table 14 is performed. 
[0059] When the value of k becomes larger than the value of K in Step 
S19it is shown that the control signal which the buffer register buf [j= 
1] stores was not searched in the control signal-equipment state 
conversion table 14. 



It returns to Step S14 againand discriminating operation of coincidence 
disagreement is performed. 

[0060] It is shown that the retrieving operation to the control signal- 
equipment state conversion table 14 to the control signal stored in the 
buffer register buf [j] completed this when the value of k became larger 
than K in Step S19It moves to Step S20 and 1 increment of the value of 
the pointer j of the buffer register buf [j] is carried out. 
[0061] In Step SlSwhen condition data S [D[k]] stored in the memory 12 
for equipment states is in agreement with the transmitting inhibition 
condition data E [k] of the correspondence stored in the control signal- 
equipment state conversion table 14it moves to Step S20. In this 
casesince it is stored in the buffer register buf [j]it hangs down and 
sending out of a control signal is not performedit moves to the 
following buffer register similarly. Step S17 is performedand also after 
being changed according to the control signal C [k] with which condition 
data S [D[k]] in the memory 12 for equipment states was searchedit moves 
to Step S20. 

[0062]When 1 increment of the value of the following buffer register 
pointer j is carried out in Step S20distinction of whether the value of 
this buffer register pointer j is over the number bufp of the control 
signals sent out from the voice recognition part 10 is performed in Step 
S21. This buffer register pointer bufp is a register pointer of the 
operating buffer register used in the voice recognition part lOand the 
value of this register pointer bufp is given to the appliance control 
part 13. This may be considered as the composition which searches the 
register pointer of the operating buffer register in which the appliance 
control part 13 was simply stored in the voice recognition part 10. 
[0063] In being below the number bufp of the control signals with which 
the value of the register pointer j was transmitted in Step S21In order 
to show that the control signal which should be generated existsit 
returns to this new control signal step SlSand search of control signal 
[ of correspondence ] C [k] and distinction of no ready for sending are 
again performed in the control signal-equipment state conversion table 
14. 

[0064] In Step S21when it becomes larger than the value bufp of the 
control signal with which the value of the pointer j of a buffer 
register should be transmittedit is distinguished that all search of the 
control signal was completed and operation of the appliance control part 
13 is completed. An example in case two or more control signals which 
should be sent out simultaneously exist here is a channel setup 



signalfor example. 

This channel setup signal can be generated to a videotape recorder 
(VTR)televisionand an audio tape deckas shown in drawing 4 . 
In this casecontrol signals differ to each electric appliance. 
Thereforein such a casetwo or more control signals which should be 
transmitted will exist. 

[0065] In above-mentioned explanation of operationthe appliance control 
part 13 can give a control signal from the voice recognition part lOand 
explains that it stores in the operating buffer register in which the 
given control signal was formed inside. Howeverthis composition may be 
considered as the composition with which the voice recognition part 10 
and the appliance control part 13 share the buffer register for control 
signal storing, nextit is the operation flow figure about operation of 
the communication processing part 3 — the drawing 11 reference is 
carried out and it explains. 

[0066] In the communication processing part 3the buffer register which is 
not illustrated is provided and the ready-for-sending ability control 
signal from the appliance control part 13 is stored in this buffer 
register. The pointer of a buffer register is given by m and the value 
of the buffer register pointer m shows the number of the control signals 
given from the appliance control part 13. Distinction of whether the 
number of the control signals first given from the appliance control 
part 13i. e. the value of the buffer register pointer mis 0 is performed 
(Step S30). When several meters of the control signal given from this 
appliance control part 13 are Othe communication processing part 3 does 
not perform communication operation at all. 

[0067]Nextin Step S30when judged with the value of the pointer m not 
being Othe communication processing part 3 distinguishes whether the 
value of this pointer m is 1 further (Step S31). When the value of the 
pointer m is Ithe number of the control signals which should be sent out 
is oneand since the number of operation target electric appliances is 
onethe recognition result (data for a display shown in drawing 4 ) given 
from the voice recognition part 10 is given in this case to the 
communication processing part 3. 

This data for a display is shown to an operator via the indicator 4 
(Step S32). 

[0068]An operator gives a transmission permission signal by carrying out 
the depression of the O.K. switch 5b included in the switch part 5when 
the recognition result displayed on this indicator 4 is seen and the 
control signal corresponding to input audio information is shown (Step 



S33). When the recognition result shown via this indicator 4 is 
raistakencancellation of a control signal is directed by carrying out the 
depression of the cancellation switch 5a included in the switch part 5 
(Step S33). 

[0069]The communication processing part 3 transmits this control 
signalwhen a transmission permission is given in Step 833 (Step S34). 
[0070] On the other handwhen the cancellation switch 5a is pushed in Step 
S33the communication processing part 3 cancels this given control 
signaland does not transmit a control signal (Step S35). 
[0071] In Step S31when it is judged that the value of the pointer m in 
which the number of control signals is shown is larger than Ithe 
communication processing part 3 shows an operator an operational 
electric appliance nameand demands specification of an electric 
appliance name from an operator (Step S40) . Presentation to the operator 
of the operational electric appliance name in this step S40 may be 
performed via the indicator 4 shown in drawing l and may be performed via 
the speech synthesis section 60 and the loudspeaker 6. In this 
caseeither one of visual information and speech information may be 
usedand both may be used. The composition of the speech synthesis 
section 60 is arbitrary. 

[0072] Presentation of the operational equipment names in this step S40 
is performed as follows. The control signal includes the information 
which specifies an electric appliancerespectively. For examplein the 
control signal von for making a videotape recorder into an ON statethe 
code of "v" shows a videotape recorder. Thereforewhat the communication 
processing part 13 looks at this electric appliance name code for shows 
an operator operational equipment names. Herewhen two or more 
operational apparatus existsand it is an above-mentioned channel 
changethere is "request to print out files." In the word a "request to 
print out files" shown in drawing 4 a videotape recordera tape deckand an 
air-conditioner can perform this reserving operation. In this casein 
order only for one electric appliance to receive operation controlit is 
necessary to specify the electric appliance used as an operation target, 
thereforethis case — the indicator 4 — " — it is the electric 
appliance A — it is — it is the electric appliance B — " — it is 
displayed. The same contents may be pronounced via the speech synthesis 
section 60 and the loudspeaker 6. 

[0073]An operator answers this and inputs the electric appliance name 
used as an operation target with a sound (Step S41). The speech 
information which this operator inputted contains only the electric 
appliance name. In the voice recognition part lOthe word dictionary of 



the electric appliance name is included and the electric appliance name 
information corresponding to this inputted speech information is given 
to the communication processing part 3 (this course is not shown). In 
this casea word and the data for a display are stored in the apparatus- 
word correspondence table UThe value of "0" is arranged so that a 
control signal may not exist in control signal column SR of the 
correspondenceand it is good also as composition with which the voice 
recognition part 10 searches discernment electric appliance data based 
on the recognition result of input audio information. 
[0074] The communication processing part 3 specifies the electric 
appliance which serves as an operation target based on the electric 
appliance specific information given from this voice recognition part 10 
(Step S41). Specification of this operation equipment is performedfor 
example like the above-mentioned by comparing with the apparatus 
specific code of the control signal which can transmit [ each ] the 
equipment code given from the voice recognition part 10. The 
communication processing part 3 presents the specified apparatusin order 
to ask an operator for a checkif the apparatus used as this operation 
target is specified (Step S42). Presentation of this specified apparatus 
is displayed on the indicator 4. It may combine at this time and this 
presentation may be given to an operator by speech information via the 
speech synthesis section 60 and the loudspeaker 6. 

[0075] An operator gives a transmitting acknowledge signal by carrying 
out the depression of the O.K. switch 5b of the switch part 5when the 
electric appliance name shown in this step S41 is checked and the 
selected electric appliance is shown (Step S43). 

[0076]When the cancellation button switch 5a of the switch part 5 is 
pushed in Step S43it returns to Step S40and two or more electric 
appliance names are again shown to an operator. When the 0. K. button 
switch 5b is pushed in Step S43it moves to Step S34 and the control 
signal corresponding to the selected electric appliance is transmitted. 
In above-mentioned compositionall electric appliance condition data 
S[i]s of the contents of the memory 12 for equipment states are set as 
the state of "0" which shows a power OFF state under control of the 
voice recognition part 10 in an initial state. Howeverafter a manual 
performs power turn operation of a certain electric appliancefor 
examplethe situation where operation of this electric appliance is 
operated by remote control is also considered. In order to cope with 
such a situationvoice input of the operating state of correspondence of 
an electric appliance may be carried out after the voice input of 
"initialization"and the 2nd voice recognition part 102 may be 



constituted so that the recognition result of this inputted sound may be 
written in the memory 12 for equipment states. 

[0077]The gestalt and communication method of a signal which are sent 
out from the communication processing part 3 just control two or more 
electric appliances individually and independentlyrespectively. 
[0078] It may have composition which sends out the control signal of 
correspondencewithout receiving the check from an operator like Steps 
S33 and S43 who shows the communication processing part 3 and drawing 11 . 
[0079] In the flow shown in drawing lO the contents of the memory 12 for 
equipment states are rewritten by the control signal C [k] [ after the 
control signal C [k] was outputted to the communication processing part 
in Step S14 ]. At this timeafter the control signal C [k] is actually 
transmitted from the communication processing part 3this step S17 is 
performed. Thereforewhen cancellation of a control signal is specified 
at Step S35 in the operation flow shown in drawing 11 a change of 
condition data S[[Dk]] corresponding to this cancelled control signal is 
not made. 

[0080]Voice recognition part lOappliance control part 13and 
communication processing part 3 each may also include composition like a 
microprocessor (MPU)and each operation may be realized by one MPU. 
[0081] 

[Effect of the Invention]As mentioned aboveaccording to this inventionan 
apparatus-word correspondence table and a control signal-equipment state 
conversion table are providedThe memory for equipment states for 
furthermore memorizing the operating state of each electric appliance is 
providedThe control signal corresponding to the recognition result of 
input audio information is searched from an apparatus-word 
correspondence tableSince it constituted so that a control signal might 
be transmitted only when the searched this control signal was able to be 
transmitted based on the memory for equipment statesand a control 
signal-equipment state conversion tablelt is not necessary to switch the 
map for conversion of a speech recognition result and an appliance 
control signal for every electric appliance used as an operation target. 
It is not necessary to form the switch for saving the IC card for 
conversion maps for every electric applianceand changing a conversion 
code for every operation target electric applianceand the speech 
recognition remote control unit excellent in operativity can be obtained. 
[0082] When the electric appliance which two or more control signals 
which can be transmitted existand serves as an operation target cannot 
be specif iedSince it constitutes so that an electric appliance name 
operational at the time of operation may be shown and specification of 



an electric appliance name may be demanded from an operatorthe speech 
recognition remote control unit which is excellent in backup 
organization when operation target discernment is impossibleand can 
operate a desired electric appliance by remote control certainly can be 
obtained. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing l] It is a block diagram showing functionally the composition of 
the whole speech recognition remote control unit which is one example of 
this invention. 

[Drawing 2] It is a figure showing an example of the appearance of the 
speech recognition remote control unit which is one example of this 
invention. 

[Drawing 3] It is a figure showing an example of the concrete composition 
of the 1st voice recognition part contained in the voice recognition 
part shown in drawing 1 . 

[Drawing 4] It is a figure showing an example of the storage 
configuration of the apparatus-word correspondence table shown in 
drawing 1 . 

[Drawing 5] It is a figure coding and showing the memory content of the 
apparatus-word correspondence table shown in drawing 4 . 
[Drawing 6] It is a figure showing an example of the memory content of 
the memory for equipment states shown in drawing 1 . 

[Drawing 7] It is a figure showing an example of the composition of the 
operating buffer register used by a voice recognition part. 
[Drawing 8] It is a flow chart showing operation of the voice recognition 
part shown in drawing 1 . 

[Drawing 9] It is a figure showing an example of the memory content of 
the control signal-equipment state conversion table shown in drawing 1 . 
[Drawing 10] It is a flow chart showing operation of the appliance 
control part shown in drawing 1 . 

[Drawing 11] It is a flow chart showing operation of the communication 
processing part shown in drawing 1 . 
[Description of Notations] 

2 Microphone 

3 Communication processing part 

4 Indicator 

5 Switch part 



6 Loudspeaker 

10 Voice recognition part 

11 Apparatus-word correspondence table 

12 The memory for equipment states 

13 Appliance control part 

14 Control signal-equipment state conversion table 
60 Speech synthesis section 

101 The 1st voice recognition part 

102 The 2nd voice recognition part 
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s^*|iJ8s^^ von A^EBirn. miiw 2 t ^ti^S 
M 2 ,!:©3^;S^i:^i^||J^|l^i^^ t o n A^ES* *lgw n 
<i:mfi^SM4tcD35jSlcti$iJilfi^a u pA^Ea^n 

ii^lCli2ji^i "0" 6^iBSl*-n^o 05^C3^l^T. ¥ 

MWi^^M i [N] o 
[00 3 1] 06tig|llC5^-r^Si^^ffl^^'J1 20 

A A R <t. ^mm^SlcS^fS LTmcom^^lS©*^® 

^mm^T-^s [i] ^^«iiftr^sDRi:^#t,-o 
«ic. *^^s [i] ti\ o<oii^ictim;:s;d-7i^®^. 

KfF 1 3 !b^fe5Sija)!tf ^©K^'F 2 V^m^yikt t 

t^o ::(0Vim9-^s [i] ©□-KlcSfoTWfScD 

[0032] il7ttElHC,T^t-^Pigil|g|J1 0 (^20) 

sp^SESPi 0 2) T'mi,^e>n^imm/i'^yT^=EV 
i^TiiB^stitii/T^LTse-r; ^2(D#is^^a5i 02 

>-5J b u f pAWT' KUXtCliJjUfi^M i [x] ^tS 



So 

[0033] ElStiEll IZTjkf^Pm^^ 1 0 

uc,7^T^isigsia5i ocDi[|f^^i:oL^Ti^^B^■r§o 

^nmm^^ o«. «]«8is^tLT. ^mti^^ffl 
^tui 2ic<§$ft*n5^stj^jfix-^s [i] ^t-'^ 
T "0" (r>m^\znmr^o iirowsiTtt. )i>tj^;<7)sm 

[0 0 3 4] JKD^S^JWi^MlCfcl^T^'f^^tiStfSfDSM 

So =^nmM^^ 0 1 tt. ii(D?^'?2^^>LT-^ 

!iil*l^n/i:ii*iSN^i^C)l^LiSiiSl^7l!I^'F^^^s3o co) 
<k*. 03tt5^-r^iggi2p/\°^->j»»i 1 3 let, fi 
•iifN<i(7)mig (migwi-wNtcstfS) i^g^^nr 
i^So mi tD^isfgiigpi 0 1 ■znmiEi^tc^mt'^^i 
(o=^n^m^^ 0 2'\^;^enSo iicD<t*. 

ISiSiSgPI 0 1 *^6li. iSiSE)ie*^<Dfe<D=&=i- RbL 

/cif fBA^n 2 (D^is^igEgp 1 0 2 ^-^x enr t cfe < . 

Sfcmic¥lgS¥» 1 1 3 (03#B§) fcd;t>«tl-mi§ 
J^fSai ilcfcntsmi§©S^<D5^^m2(D#^ig^gp 
1 0 2'\4^S«fi!6<tLTfeJ;t\ |gl8^i:fcl^T^i> m 
1 (D^PE^gPI 0 1 ^b^eiiSSSl 1 3$fctt«-* 
l§WfE;aiCj3ttS*l§S^ (W 1 - WNlCfcttS 1 - 
N ) X ti^m 2 CDSPfgiSgP 1 0 2 'V-^-^ 6 tlSJi^*^/7^ 

Ux'yys2) o 
[0 0 3 5] m2(D^PsglSEa51 0 2ti. ilCD^KD^ 

^isingpi 0 1 *-6mi5S^x^-^^6ns<h. s-r/^~ 

•y7 7'bv'X^a)7K<>'S?bu f p^Olc|S^rst<h 
fcttx W^t"—^ S [ i ] tcj5ttSi^S#^ i 1 1CS 

^rs Ux->ys3) o 

[0 0 3 6] ll2 0#|Sigi{g|51 0 2ti. «^ 

-msmai i'\^comig#^xini^oT7'?-bX 

U mcDityil^^M i [x] ^)^OT-feS6^S3b^^WgU 

■rs Ux'yys4) o cniccfcy. mss^xit^fS 

LTfg^*nS'^**iJWl^<DSJi?*i^^^S^3tlSo 
[0 0 3 7] "0" TW$'JWI^M i [x] 

tifcii^. iitniut=]>^a6^65g^*ns'^*iyin 

fl^TS tl. 0 7 lc,T^-r/^'-y 7 bv'X'Jf b u f [b u 

fp + 1] 'Nfflwi^Mi [x] A^*s$fi*n. 

7\ /\'>y77'Uv''X^7f^'r>-S'bu f p6Mtg^?n 

So iintcj;^. $-r; /^-y^z^vy^ "1 (=bu 

fp+1) " (DM"-y 7 T uyx-JJ icS-tLTSyHfi^M 1 

[x] *^*S*A#tlS Ux-y7'S5) o 

[0 0 3 8] 7.x•y3^S4^Ciil^T^ m^iilS i tcSitJS 
■rsSiJiPfi^M i [x] A^OOJli^tcti. Xx'yyse 



[0 0 3 9] Xx>y^S6lc33U^Tti> mm^S§S## 
mati^o Xx-y^^S 7T i 6^ I cfcUt:*:*l^<!:W»J 

[0 0 4 0] Xx•yyS7^^:fcL^T*/c■r'<T(^)SMi« 

fctimigWx) ©$5j^lC^3iBTS*JWi^M i [x] 6^ 
[0 04 1] Xx7■/S7^^:^Jl^T i *M 

7 iZTjkt/ 7 7 y ^ y ictSSrt* tifcSiJ^ifi^M i 

[x] ^t<Tmm^m^^ s^mtit^ Ux-y^s 

[x] (Dmi. /\'>77'<K-f>^fbu f plcj:y-^;^6 

[0 0 4 2] cdT. ±5E(D7P-^ctel^T^i. mm;^ 
(D'mmt>m(Dmmt'^^mi^nzi5^j. ckdw i + 1 ~ 

W2. I ©^Hltli^il£OmM^S0Sj!g^7ffl©mfS 
[0043] ^mijmgP 1 3 ti. ^ISlS^gp 1 0 6^6$iJ 

[0 0 4 4] ^tcXT^yzfsiiztsi^T^m^ma^mm 

a95 3'\f5ji#n^o CiDas^ffl^— S^cD5^lS^^:oL^T 

[0 0 4 5] :k[zm8[Z7jktX7''yys9(Dmmm^ 

1 3c^)ll^TSI#op,^ffl^col^Tl{^s^■r§c 

[ 0 0 4 6 ] 0 9 immm^-m^vmMitsm(Dtm[^ 

5'^**|J^lHl^c [k] ^^mr^mmm^msR. 

i*f^3*^<!:^«m^«ISD [k] ^^SSifl-rSilS^^JA 

sRts^xfmmo^mism^^n^E [k] 



[k] ti. i^46$yffl!fi^C [k] icMtSLTS^^n 

^(OWm:ty\Zt^ "von" ©li^. TT-lCbiW 
X - 7 b n - ^fomagjb^Ti- y^m[z fenii' ^ WI^ 

von icS^fSLT. LTex7t-x-7 

m-^'^/T^-r "1" 3b^a^^s«<D [k] tLxmM 

[k] t LT«;JS;i->«SI^S^-r "1" A^^^^tiSo 
[0 0 4 7] d^jllfiSllh^frT^-^iE [k] \.Z\t. C 

(Dmi^X(Dm±^ r^iit'^mm^n^o cnti/tixii; 

^ismiiw i t^^^^^)l^:^m "V TSU. ^fFS^ 
^mm^SD [k] *^t!x7t-7^-yU=l-lS«'tS^*tl 

A^os^fSroii^ii^i^^i^T^-^ E [k] jb^iJiiiSifFttte 
^imtchTjii "2" ttis^*ti5ii<!:it<feyii^i*n 
So -r^fe-s^ iiijiiii^c [k] im-^t^'^%)m\i 
[k] ft^ssibfFtt^iCcfey. ^(mmmmf^m^ 
m-E [k] t-ife-rsii^itti. ^(DMWf^c 

[k] (7)jilil*^«lt*nSo LfcA^oT. C(D$iJ?aifI^ 

-^st«ciSMrs« 1 4 ^cfcx^T^t^i^s^,5lJ A s r tc^s 

*ft*ns«^^SD [k] jb^fi^fSSmilSti. 
inSiJfflfi^C [k] =&§ttssmii^<!:t±ifs-rLt- 

jjtt s X u tifDsasTi- 7fij#ii^±#nSo 

[0 0 4 8] J^SiSiMl 3(Di!)mc-^i^T^<^ 

gjfF^p-^g^-rEii o=&#BgLTUi0^-rSo 

[0049] C d T\ :ilS$iJ» 1 3 iCfclNT fc^ HI 7 
tc5^-r/\'y 7 7 bv'X^^iM'Fllffl bv'X'J? <!: LTISttb 
nTL^Sli^^«^-rSo c:(D;l^$iJiPg|51 3|^(D/^y 

JttStD/ ^y 7 T' U S>~7. 1? iC^SSft* nso 

[0 0 5 0] i!:<D/^y7 7'Uv''X^fCD7K'l'>'5iti. jT- 
/T^To E17<^/^y77' U>''X^TfflL^6nfc<K-l'>'S' b 

To t^-fySi j cD/\''y 7^^ bv'T.^tib u f [ j ] Tvt^ 

to 1 ^ j ^ J T-sso «fc> sijaifi^-^sttjg)!*)^; 

[00 5 1] $-r^S$'JiPgP 1 3 it. ^(OJ ^'-y 7 y bi/' 
X^CDti-fySibo f pA^ "0" TSSi^SA^^W^r 
S Ux'y :j^S1 1) o /\"-y7 7'Uv''X^/K<>'$zbu 

f p*^ "0" (DJi^lcli. /\"'y7 7'Ui>'X^l;:li3ll«-r 

1 3t±^<Di!i#^^7-rSo 

[0 0 5 2] Xx'y7"Sl Ucfcl^Tig7a)/^y7y'U 
v'"Xi?<K'r>^b u f p3b'< "0" T-^l^tfiM^n/cS 
icti. ^-ri #g<^/^'y7 7'Uv''X'Jf^5lS?-rsfcA6lc 
/I^W:?' j 6M ItlS^^nSo i:nii:cfey/S'7 7 7'Uv>~ 



-mmv(m1ciJ^m^zts\,f^^^'iymmiM^c [i] . 
smiiSD [1] ts^xfmmm±^^r-'^E [ii 6^ 

[0 0 5 3] XT'yyS 1 2^^:i5l^Tfi^^tlfcA"y 7 
T' Uv^'X-? b u f [ j = 1 ] ©IBISf «*'JiP^i^6^S'Ji) 

m^-mmimmm^z^^n^mmm^c [ k = i ] 

4) <, 

[0 0 5 4] Xx-y^l 4^^:^5t^T-SI^l^M^li^■tl/i:Ji 

mo [k=i] (Dttsir-^s [D [k] ] ^mmt 

x-^fS [D [k=1] ] 6^$iJ1|Ifi^-^S«^«JSa 

1 4 ic^surt* n«JiifiSi±^#x-t? E [ k = 1 ] 
^r^is^'siif^a^mmnisi^n^ Ux-y^^si 5) „ 

[0 0 5 5] Xx'yys 1 5lCfclNTs ^S^SIx-^ 
S [D [k=l] ] MlS±^#x-^E [k=1] 

tmL<ri[.^mmntzm^. ^(oumm^c [k= 

[k = 1] AM£S7*-nS (XT^yT^SI 6) . C£D 

[0 0 5 6] mmm^^ 3ii. sfijasasicsijiaifB^ 
c [k=i] ^mtiLtzm. tmmm^c [k=i] 

S [D [k=1] ] (Dim^Wt^o t1S:t>-^tct?Lii 

Mmm^c [k = i] *^mas7t->fi^r»§Ji^tcii. 

s [D [k = i] ] tMictg^irn. $ 

/j:«li?|-7fi#tOJg^ltti. SfS [D [k = 

1] ] 6^ "0" IcS^itn;^^ 
[005 7] 7.x'y:^S 1 4^^:J5l^T> A'-y^rUv^X 

^buf [j] (o^mumm^mimm^-mmm1ci 
fsa 1 4 izmmtn^mm^ c [ k = 1 ] <t-a 

n§ Ux-y^S 1 8) o 

[0058] ccok (ommmm^-m^vimMitm i 

l^TlT^^Dtl Ux-y^SI 9) . iI<7)kcDfil3b^KC)iit 

J; u t,/J^^l^Ji^^c^i. bo-xt^ -y t^s i 4 'xbi u . sij 

[0 0 5 9] Xx'yysi 9tc33l>Tk£Dii)!j«K(7)^i«fc 
U t:*:* < ^^/cig^lcli, /^y 7 Uv'X^ b u f 

[ j = 1 ] (D^mt^mmm^my@m^-umvimti 
^tm^ 4^^fcl^T!K3^^tl^*^ofc^:,^^5^LT^5^J. 

WU-Xx-yT^S 1 4'\g|U-iSc^-Sc^)i|iiMfFmTS 



:*:#<^-3/cJi^. iini4/^'y7 7'Uv'~X^?bu f 

[ j ] ^c^s^^^^n/c$'J^sffi^^^:)l^f■rssy^anl^-Mss« 

m^Hm 1 4 'vco^tP^Kf^A^^T Lfc C t LTfc 
Xx>y^S2 0'\jgy. M'y7 7'Ui>X-?bu f 

[ j ] <D7f^-f>^ j cDiiAi^ 1 m^in^o 

[0 0 6 1] S/cXx-y^Sl 5lCfcl>T^ 

yi^uMiz^mi![nrc^m9—$'s id [k] ] ^b^^iij 
wi^-^s^jgmai Aiz^mn^mscommm 

±^ffx-t?E [k] <!:-Sc-rsii^lJ:tiXx7 7'S2 
O'v^So iI©Ji^lJ:tt/\'y7 7'bv''X-$!b u f [j] 

:^lc;^(0/^y7 7'Uv'X'SJ'\^§o Xx-y7^S 

-^s [D [k] ] t^mmtntcmmis^c iki icfs 

L:T^MT^tl/c^tct,Xx-y^S 2 0^^^. 
[0062] Xx'y^S20 lZtSl^Z'k(r)J Vjl)y [y'J 

u^x^/i^-rv^ j ^Pis^gpi o^^eiMttj* 
nmmm^<r>m u f p^s:^Ti^§A^S3b^cDfji5ij6"^ 
Xx'y:^s 2 1 ^i:^5L^T^TSt>n5o c:(7)/\'"y7 7'U>*' 
x^i/K'T^'? b u f pii^Pigiigpi o^c^Ju^Tffll^6 
nfcf^Uffl/ ^y 7 7 u->'x^ 0) u v'x^ v-j? 

cKDUi^x^^K-rv-Sf b u f p(oimmmpm^^ 
3 'N-^^ 6n§<, ^ln^4ilmlJ^a)a5 1 3 ^ m^icWPig 
issp 1 0 iznnm-^ntc^mmj^y 7 t' uv-x^^© us^x 

[0 0 6 3] X7^'y:^S2 1 icfci^T. Uv'x^/K-ry 

j ©{ii6^gi^^tlfc*yWf^©ISb u f pJ-XTWif^ 
LTt^5fc46. C:ro»Tfc^*iMi^7.x'y7^S 1 3^%^ 

*jfflifi#c [k] <D^mt3.i:xfmm^'smmm=irj:t> 

[0 0 6 4] Xx'yyS2 1 ^^:^>l^T. /\-y77bS>'X 

^07ii^y^ j (Dii3b^H^^i^tl5'<*^|JSBlfi^©^ib u 
t^o mmz'Mih-i^n^^i^mm^tmm® 

i:cD^^;^/H6^M^t4EI4lt5^-r«fc3lc. tx";*- 
x-7'U=i— 5«" (VTR) , xbev»'3>33<i:tf7t--x 
^ * x-^x -y +lC)t>f LTfl^r ^ tA^wrtET-fe^o 

So Ltct^-DZ. zcD^otim^izimWicommi^n^ 
[0 0 6 5] r^is±^mmimizisi^zu. mmmm 

351 3 "^PmM^l 0 6^eMWB^^-^;^6.n. ^ 

©4^6 n/cSijiJ^^^rtasttstt 8 n/cfFUffl/ n" -y 7 
r iyi>'X'$nz^mt^^o izmn lti^So ls*^ 

in :'/T\Mtci}(+ *ii»n/es.i*tAmif,., -7-77 1 ,,-y-7 fc^s 



[0 0 6 6] ii^I^alsg|5 3^c^Jl^T^ix m^^Lr^ivXy 
•y:/s3o) o iKD^^iumasi 3 3t)^6-^^en/c» 

[0 0 6 7] Xx•y:/S3 0^^:^5l^T. tK-O'?? 
m(Dim 0 T■^l^<^:|lJ^#n/^:Ji^^^:^i. iifliQSas 3 

tT^5 a7^'y7'S3 1) „ ^^^>^m(DimM:'S>^ 

m^. i^m^mnmmt 1 ':>T'&^tcisb. ^mmtm 
1 06^6-^^enfcis^*£^ (Ei4ic5^-ra/Txffl7=^- 

-Si) 3bWiSfiag|5 3'\-^:^6nT*5tl. (KOmTjkmy'- 
2) o 

[0 0 6 8] mY^^itucom^s^Aizmwi-^ntcmm^ 

S3 3) „ $/cJ:<D^,T^gP4^^LT3i/7x#nfcigiS!^ 

Y >y ^ 5 a ^ffTt 5 C <!: J: U $iJ1|ifi^cDlX>S L=£fi 
/7^T5 (Xx'y7'S3 3) o 
[0 0 6 9] ii<Hl[iag|5 3ti. Xx-yT'S 3 3^i:^5l^T 

(7.x'y:/S3 4) . 

[0 0 7 0] Xx'V^S 3 3^c^5l^TIX;SX^'•y 
^ 5 a tifcig^lc li. iifiSaSSP 3 li C 

(Xx'yyS3 5) o 

[007 1] xt^'v^s 3 1 ^c^^l^T^ $iJWi^a)ia^ 

0) „ i:©Xxy7S4 0ti:fcH:)-;5^f^Rltg^M^S«i 
<DmY¥^^(Omyrsit. mi tCu^Ta5^gP4«-i>LT?TS 
*3nTtd:<. $/c«|S^fi!6g|56 0*5j;tfxe-:^3 6^ 



[0 0 7 2] JI(7)Xx-;'7S4 0lCfclt5^fFnI#g^^ 

#vonlcfcl^T "v" ©□-Ktit'7=^';d-x-7'U=l- 
gpi 3!ti^m«j:ttcd;y^#PrtgilS«,*Hlf^*lcJi5^ 

nSc ISl UrtSt^^lS^^gp 6 0 X k-:^ 6 
[0 0 7 3] lll<'^#liiinicj;SgLT. mnnWi-tr^^ 

5c ^puiiigpi o^^:fcl^T^i. mm^^(o^mmm 

t) o CCDii^. ^S|-mi§3tfSS 1 1lCfcl>Tmig*J 

s R ^i:^^t^T^i^y^i^i*A^#^^ lsi^ 3 " 0 " 

(7)fiA^E9J*tlT*iy. ^PiSiUgPI 0A^A:^^^1t$S 
[0 0 7 4] 3ifI5QSgi5 3 ti. Jiro^^^^gP 1 OA^e 
<7)!|tSti. tct7i\.f. wiv^coz^t^. ^^iSiSlgpi 0*^ 

^A^m.7fsl£n^o iI£O<i:##-y-TWP^fi)6956 0*5j; 

[0 0 7 5] m^mi.<l<r>7.'r^yys 4 1 ^C^5l^T^i/7^ 

* tlTl^^Jf^tttiX'f >y ^35 5 K X'T ^ 5 b ^ 
ffT■r5iI<!:^^:J;^J^^iiiS^I^^^^5 (Xx-y7S 
43) o 

[0 0 7 6] Xx-y7S4 3lCfcWX<-y^g|5 5 0)lX 
Jg*'-? yX'T 5 a A^ff tlfclg^Xx 7 "/S 4 0 



[i] {tt^zmmtyvim^^st "o" cDt^^icis^ 
[0 0 7 7] afijaisgi53 6^ejiitu*n§ff^©jf$^fc' 

[0 0 7 8] Sfciifii!QSg|53. 1211 1 iCS^-TXx'y^^ 
S 3 3 iS^XfS 4 3 © <fe 3 SHIfF«*^e©5iig^§tt5 

[0 0 7 9] *61C. 1211 0 1^5^1-7 P-lCfcl^m 

xx-y >^s 1 4^^:^5l^T^iiim^!^lagp^^:$|JS9fi^c 
[k] *^tti:':*nfdg«S«^«y^ 'J 1 2<DF«3§6^ 
W'lifi^C [k] lcjS;L;T»}l!;^6nTt^So dtot 

jifijaisgP3 3b^eiii^tc»fi^c [k] 6^5^* 
n/c^lc lKDXt^'v 1 7 6MT^;bti^= LfcA^o 
T. Ell UC/T^-rij!lfF7P-ltJ>t^TXx-y7S3 5T- 

n/tiuwi^tcWDST^t^^x-^ s [ [Dk] ] (om 

[0 0 8 0] *eiC. ^^Egl951 0. ^SSlMl 

3. ^ifi^^ls^53^>^^^iv•<'?□^□-b•y■y■ (mpu) 

[008 1] 



So 

[0 0 8 2] '^M^mrj:mimm&.^^ 

isb. mmwmm'^m.o^m'^^zis[^:hi%^'j'7T^u ifm\ 
\zm.. t-^'oWim.co^imm^mmz^mm^t^'it 

mo^i^aymmmmmzmya -y ^st-^^So 
mi] z(o^Bnco-mmmT&^'sm'^^'j=Eziym 

msi mMzmmp^Wimz^^n^mi (o^pm 

MA] mT[Z7jktmm-mmtii^m(ommmm(D-m 

[H5] 04tc,T^T«iS-mi§ma©iB1trt§^=l- 
[06] 01 ICS^ r^S^^ffl ^ ^ U tDIB1SF«g§(7)-^J 
[H 7 ] ^PEiSEa5T-fflL^6nSf^llffl/\'7 7 7 Uv'X 

ma] m^^z7^^t^mm.m^(DW}^^7^stya-ml:' 
[09] mMZ7jKtPmm^-misvimn!tM<Dtm\*i 
[010] 0nc^rii^$y»cDiiifP^.T^-r7P-0 
[01 1] m-nzTjktmmmm^cowj^^Trstya-m 

[^^(DIKB^] 

2 v-r-j^ 

3 Mfisasas 

4 as^gp 

5 X-Ty^^ 

6 Xtf-:^ 

1 0 MPmm^ 

1 1 ^S-Pli3>ff5« 

12 mmv^mmy^'E'j 

1 3 il^$iJ1Sl^ 
6 0 ^^^figgP 

10 1 m^ (D'^m'^msi 

102 m2(O^Pigig6SP 
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